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Abstract 



The properties of value functions of time inhomogeneous optimal stopping problem 

^^ ! and zero-sum game (Dynkin game) are studied through time dependent Dirichlet form. 

^J ' Under the absolute continuity condition on the transition function of the underlying 

(-H ■ diffusion process and some other assumptions, the refined solutions without exceptional 

starting points are proved to exist, and the value functions, which are finely and cofinely 

continuous, are characterized as the solutions of some variational inequalities. 
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^ 1 Introduction 

o 

^^ I Let M = (Xj, P(s,x)) be a diffusion process on a locally compact separable metric space X. 

For two finely continuous functions g, h on [0, oo) x X and a constant a > 0, define the 
following return functions of optimal stopping games: 



J(,,,)(a) = E(,,,)(e-°'^(7(s + a,X,+,)) (1) 

J(,,,)(r, a) = E(^s,x) [e-"(^^'^) {g{s + a, X,+,)/,>, + h{s + r, X,+,)/,<,)] . (2) 

The values of the stopping games are defined as eg = sup^ J{s,x){o') and w = sup^ inf,- J(s,x){t, o"), 
respectively. This kind of optimal stopping problems have been continually developed due 
to its broad application in finance, resource control or production management. 

In the time homogeneous case, where M, ^f, h are all time homogenous, it is well known 
that Cg is a quasi continuous version of the solution of a variational inequality problem 
formulated in terms of the Dirichlet form, see Nagai |S] • This result was successfully extended 
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by Zabczyk [T2] to Dynkin game (zero sum game) where w was shown to be the quasi 
continuous version of the solution of a certain variational inequality problem. In their work, 
there always exist an exceptional set A^ of starting points of M. In 2006, Fukushima and 
Menda [3j showed that if the transition function of M is absolutely continuous with respect 
to the underlying measure m, then there does not exist the exceptional set A^, and Cg and 
w are finely continuous with any starting point of M. 

However, more work is needed to extend these results to the time inhomogeneous case. 
Using the time dependent Dirichlet form (generalized Dirichlet form), Oshima [8j showed 
that under some conditions, Cg (also w) is still finely and cofinely continuous with quasi 
every starting point of M, and except on an exceptional set A^, Cg (also w) is characterized 
as a version of the solution of a variational inequality problem. 

Recently, Palczewski and Stettner [9] [10] used the penalty method to characterize the 
continuity of the value function of a time inhomogeneous optimal stopping problem. In 
their work, the underlying process M is assumed to satisfy the Feller continuity property. 
Lamberton [4| derived the continuity property of the value function of a one- dimensional 
optimal stopping problem, and the value function was characterized as the unique solution 
of a variational inequality in the sense of distributions. However, that result was difficulty 
to be extended to multi-dimensional diffusions. 

In this paper, through the time dependent Dirichlet form, it is showed that under the 
absolute continuity condition on the transition probability function pt and some other as- 
sumptions, Oshima's [8] results still hold and there does not exist the exceptional set for the 
starting points of M. This result is then applied in Section H] to the time inhomogeneous 
optimal stopping games where the underlying process is a mult i- dimensional Ito diffusion. 

2 Time Dependent Dirichlet Form 

In this section we define the settings for the time dependent Dirichlet form that are similar to 
those in [8], although some results from [TT], whose notions are different, will be used later. 
Let X be a locally compact separable metric space and m be a positive Radon measure on 
X with full support. For each t > 0, define {E^^\ F) as an in-symmetric Dirichlet form on 
H = L^(X; m) and for any u E F, we assume that E^^\u,u) is a measurable function of t 
and satisfies 

A-^mIII < ^f (m,m) < A||m||^ 

for some constant A > 0, where Ea {u,v) = E^*^\u,v) + a{u,v)m, « > 0, and the F norm 
is defined to be \\u\\p = E^ {u, u). We also assume that F is regular and local in the usual 
sense p. 

Define F' as the dual space of F, then it can be seen that F G H = H' G F'. For each 
t, there exists an operator L^*) from F to F' such that 

-(LWu,i;) = eW(u,w), u,veF. 



Further the F' norm is defined as 



\v\\f' 



sup {{v,u)}, 

ll"ll-F = l 



where (w, u) denotes the canonical couphng between v & F' and u & F . 
Define the spaces 

^ = {y,(t,.) eH : ll^ll.^^' < oo}, 



where 

and 

where 



I Il2 



flMtrnUt, 

Jr 
^ = {ip{t,x) e F : \\(p\\^ < oo}, 



M% 



Mt^-nut. 



Clearly ^ C J^ = Jf" C J^' densely and continuously, where Jf', ^' are the dual spaces 
of ^, ^ respectively. 

For any Lp e ^, considering y? as a function of t G M with values in F, the distribution 
derivative dip/dt is considered as a function of t G M with values in F' such that 



dip 
'dt 



(t, ■)^{t)dt 



ifit, ■)eit)dt, 



for any ^ G C^(]R). Then we can define the space W as 

dip 



W = {ip{t,x) e^:^e^', Mw < oo}, 
ot 



where 



I Il2 



dip 



dt 



+ II^ILf 



^' 



Since ^ and ^' are Banach spaces, it is easy to see that W is also a Banach space. Further, 
W is dense in ^. 

We further define the bilinear form S by 



£iip,i)) 



<3^ 



-{%^P)+ [ E^'\ip{t,-),^it,-))dt, ipeW^^pe^ 
dt Jk 

{^,^)+ I E('\^{t,-),ij{t,-))dt, ipe^.ije 



(3) 



'd'P 



where {-^,^) = J^ {^^^) dt- We call {£, ^) a time dependent Dirichlet form on J^ |8]. 



As in [8] we may introduce the time space process Zt = (r(t), Xj) on the domain Z = RxX 
with uniform motion T{t), then the resolvent Raf of Zf defined by 



CXI 

-at . 



RJis, x) = E^s,.) ( j e-'^'fis + t, Xs+t)dt ) , is,x) = z, fe ^, (4) 



satisfies 

'a - 1^ - L^A RJ{t, x) = fit, x),Wt> 0. (5) 



dt 



Furthermore, Raf is considered as a version of Gaf G '^, where Ga is the resolvent associ- 
ated with the form Sa{,) = S{,) + a{,),y and it satisfies 

Sa{GJ,v) = {f,vU V<^G^, (6) 

where dh'{t,x) = dtdm^x). We may write (■, ■)y as (■, ■)^ to indicate it as the inner product 
in^. 

We now define ^ as a bilinear form on ^ x ^ by 

A{^,^)= f E^'\^{t,-),ij{t,-))dt, 

JR 

and set Aa{f,ip) = A{(p,'il>) + a{ip,'ip)^^, then it can be seen that £ai^,i') = ~("^!^) + 
Aa{(p,ip) Hip eW,ij e ^, aiadSa{ip,ip) = {^,(p)+Aa{ip,^p) Hip e ^,ip eW. Also notice 
that if 9? G W , {-^, (p) = 0, hence Sa{<p, <p) = Aa{^, ^) in this case, see Corollary 1.1 in |7]. 
A function ip E <^ is called a-potential if £a{'^i'4^) > for any nonnegative function 
ip G W . Denote by <^q, the family of all a-potential functions. A function </? G ^^ is called 
a-excessive if and only if y) > and nGn+af < V' a-e. for any n > 0. For any a-potential 
if G ^, define its a-excessive modification as 

(f = lim nRn+af- 
For any function g G J^, let 

-Sfg = {f E '^ : f > g V a.e.}, 
then the following result holds (see Lemma 1.1 in [8]): 
Lemma 2.1. For any e > and a > 0, there exists a unique function g^ E W such that 

^,n>j + E^\g:{t,.U) = -^{{g:{tr) - g{t,-))-,u) (7) 

for any u E F. 



As a consequence, (yff solves 

SM.i^) = \{{9':-9)-.i^).^. vv^e^, (8) 

see Proposition 1.6 in [llj . 

By Theorem 1.2 in [8], e^ = W.TH^^Qg'^ converges increasingly, strongly in ^ and weakly 
in t^, and furthermore, Cg is the minimal function of 0^a H ^g satisfying 

^a(eg, eg) < S^{eg, 4j), ^^ e ^g n W. (9) 

Given any open set A G Z, the capacity of A is defined by 

Cap{A) = £a{ei^^ip), ip G W,ip = 1 a.e. on A. 

If (/? G t^ is an a-potential, then there exists a positive Radon measure /i" on Z such that 

Ec.{^, ^)= f tpiz)dfj.'^{z) for any V G Co(Z) n W 

Jz 

By Lemma 1.4 in [8], /i^ does not charge any Borel set of zero capacity. Put e^ = e/^ and 
A*A = /^EA' then the capacity of the set A can also be defined by 

Cap(A)=/i^(A). 

The notion of the capacity is extended to any Borel set by the usual manner. A set is called 
exceptional if it is of zero capacity. If a statement holds everywhere except on an exceptional 
set, we say the statement holds quasi-everywhere (q.e.). 

3 The Time Inhomogeneous Stopping Games 

In this section we will characterize the properties of the value functions ig = sup^. J{s,x) (c^) 
and w = supo- inf ^ J(s,x) (t, cr) of the time inhomogeneous stopping games. We first assume 
that the transition probability function pt of the process Xt satisfies the absolute continuity 
condition: 

Pi(x,-)<m(-), Vt. (10) 

In fact, the Feller property in [D] implies the absolute continuity condition on pt, see, e.g., 
page 165 of [T]. 

3.1 The Time Inhomogeneous Optimal Stopping Problem 

Consider eg{z) = sup^ ^^(o") where 

Jz{(t) = J(,,.)(a) = E(^s,x){e-'"'g{s + a,X,+,)). (11) 



Oshima showed that (see Theorem 3.1 in [8]) if (7 G ^ is quasi continuous and S^g \~\W ^ (p, 
then eg{z) G =^ is finely and cofinely continuous q.e., and Cg solves the variational inequality 
on]). In what follows we give conditions under which Cg E W and Oshima's result holds 
without the exceptional set. 

It is assumed that g eW is a. finely continuous function on Z such that 

\g{t,x)\<^{t,x), (12) 

for some finite a-excessive function ^p eW on'L. We also assume that there exists a constant 
K such that 

snji-\M~gr\W<K\\gU', (13) 

where g'^ solves ([7]). In the rest of this section, the notion Ki for some index i denotes a 
constant. 

Lemma 3.1. Under the assumptions [W\) and ^M), Cg eW . 

Proof. It has been proved that Cg E Cg H Pa, and Cg G ^, see Theorem 1.2 of [8] or 
Proposition 1.7 of [11]. Furthermore, 

sup||5f°- v^ll,^ < Ki\\ip\\^, 

e 

and 

sup llfi^nU < sup ll^f" - ifW,^ + \\ip\\^ < Ki\\if\\yy + \\if\\.^. 

Now that g'^ satisfies 



we have 



dt'^' -'"^-^'--^ e 



I^^IL^'= sup (^^,V') 



= sup (AM.i^)--{{9:-9r.i^)^ 

< sup Aa{g^,%lj)+ sup - ((^,"-^)",^)^ 
By the sector condition, 

AM.i^)<K2\\g:yuy. 



(14) 



hence 

sup Aa{g':,^)<K2\\g':U. 

IIV'll,^=l 



%-\\w\\.^, 



On the other hand, by Cauchy-Schwarz inequahty, the following holds: 

and 
hence 

1 ., „. . ,x 1 



sup -{(g:-gy,^)^<-Ks\\9:~ 



Now by taking sup^ of ( fT4l) and by ( IT3l) we get 



1^- 



^a 



sup l|-^l|j?' < i^2^i||v5|k + K2\\(p\\.^ + KKs\\9\\jf < oo. 



Therefore 



dg" 

sup ||C/rik = sup ( ll^ll^' + hel^j .^g. 

< K2Ki\\ip\\^ + K2\\(p\\.^ + KK^\\g\\^' + Ki\\ip\[^ + \\ip\\,^, 
and as a consequence, e^ G ^^ by Lemma 1.2.12 in [5j. D 

Corollary 3.1. There exist constants K^^K^ such that \\eg\\y^ < K^WifW^^ + K^\\g\\,^. 
Proof. This can be seen by Eq. OlSI) in the proof of Lemma l3.ll and the fact that \\<f\\^ < 

llv^ll^. □ 

Now we can revise Theorem 1.2 of [S] and get the following result. 



Corollary 3.2. Under the assumptions (1^1 and u^) . Cg = lim^^og'^ converges increasingly, 
strongly in ,W , and weakly in both ^ and W . Furthermore, Cg is the minimal function of 
^^n^gHW satisfying 

Saicg, eg) < Sa{eg, ^), V^ G ifg n W. (16) 

Proof. Now that Cg G W, so {-^,eg) = (see Lemma 1.1 of [7J), hence Aa{eg,eg) = 
Sa{eg,eg). The rest of the proof is the same as in [8]. D 

Theorem 3.1. Let g{z) = 9{t,x) be a finely continuous function satisfying [W^] . Assume 
^^^ and the absolute continuity condition / flOj) . Let Cg be the solution of / fJ^) . and Cg be its 
a-excessive regularization. Then 

eg{z) = sup Jz{cr), V2; = (s, x) G Z, (17) 

(T 

where Jz{o-) = J[s,x){o') = -S(s,x)(e~"'^5'(s + a, X^+o-)). Furthermore, let the set B = {z E Z : 
eg{z) = 9{z)} and let gb be the first hitting time of B defined by (Tb = inf{t > : eg{Zs^t) = 
g{Zs+t)}, then 

~eg{z) = Ez[e~^^-g{Z,^,,)]. (18) 



Proof. Notice that if A Cg is an a-potential dominating g, and Cg is the smallest a-potential 
dominating g, we get Cg < ip ACg < ip u-a.e., which implies the finiteness of Cg. 

Now because Cg > g u a.e., we have nRn+a^g{z) > nRn+adiz), V2; G Z, n > 0, and this 
implies 

(ig{z) > lim nRn+ag{z), Wz G Z. 

n— >oo 

By the absolute continuity condition and applying the dominated convergence theorem, the 
following holds, 

lim nRn+ag{z) = g{z), Wz G Z, 



therefore eg{z) > g{z), \fz G Z. Then we have 

eg{z) > E, (e-"'^e,(Z,+.)) > E, (e""'^(7(Z,+.)) 



(19) 



for any stopping time a, which implies eg{z) > Jzicr), Vz G Z, hence eg{z) > sup^. J^(cr), 
V^gZ. 

Since Cg is a bounded a-potential, there exists a positive Radon measure /i" of finite 
energy such that 

Saieg, w)= I w{z)fx''{dz), Ww G Co(Z) n W, (20) 

Jz 

and eg{z) = Ra^{z). 

Under the absolute continuity condition (TTUj) of the transition function, there exists a 

positive continuous additive functional At in the strict sense (see Theorem 5.1.6 in [I]) such 

that 



egiz) = Ejf e~'''dAtY Wz E Z. 
Set B = {z E Z : eg{z) = g{z)}, then 



B'= 



{eg{z) - g{z)) jj.^'idz) = / {eg{z) - g{z)) jj'^idz) = Sa{eg,eg - g). 



Since eg is an a-potential, and eg — g is nonnegative, Sa{eg,eg — g) > 0, which implies 



<^a{Gg, Gg) 



Sa{eg,g) > 0. On the other hand, eg satisfies (IT6l) . which implies Sa{eg,eg 



£a{eg,g) < 0. Now it can be concluded that 8a{eg,eg) — 8a{eg,g) = 0, hence jji"{B^) = 0. 
Further we get 

Ejf e-'''lBc{Z,+t)dA^ = R^{lBcii){z) = 0, Wz E Z. 



By the strong Markov property, we have for any stopping time cr < as 



eg{z) = E, 



-at 



dAt 



+ E,[e-"'^eg(Z,+.)], 



(21) 



and because 



0<E. 



e-^'dAt 



IJO 



< 



eJJ e-"*/Bc(Z,+,)t/At') =0, 



we have eg{z) = Ez[e~""eg{Zs+a)], o" < ctb- By replacing a by cr^ and replacing eg{Zsj^„) 
by g{Zs^„g), we get eg{z) = Ez[e^°''^'^ g{Zs^„g)], and this together with (TT^ completes the 
proof. n 

Corollary 3.3. Under the conditions in Theorem \3.1\ eg{z) is finely and cofinely continuous 
for all 2 G Z. 

Proof. Oshima [8] has showed that eg{z) is finely and cofinely continuous for q.e. z, and 
under the conditions in Theorem I3.H we showed that there does not exist the exceptional 
set, so eg{z) is finely and cofinely continuous for all z E Z. D 

Remark 3.1. Since Xt is a diffusion process, we can see that eg{z) is continuous along the 
sample paths. 

In Palczewski and Stettner's work [9][l0], the optimal policy is to stop the game at the 
stopping time &b = inf{t > : eg{Zs+t) < fl'(^s+t)} o'^ equivalently &b = inf{t > : 
eg{Zs+t) = g{Zs+t)}- Notice that &b < ctb, by Theorem 13. II we can see that 

eg{z) > E,[e-''^^eg{Zs+.^)] > E,[e-"'^^e,(Z,+.J] > E,[e-"'^^(7(Z,+.J] = eg{z), Vz, 

hence 

and as a byproduct, we get the following result: 

Corollary 3.4. Under the conditions in Theorem \3.1[ there does not exist the exceptional 
set of irregular boundary points of B. 

Therefore it is feasible to replace as by &b in the results in the rest of this paper. 

3.2 The Time Inhomogeneous Zero-sum Game 

In this section we will refine the solution of the two-obstacle problem (zero-sum game) in[8]. 
Let g{t,x),h{t,x) E W he finely continuous functions satisfying 

g{t,x)<h{t,x), \g{t,x)\<if{t,x), \h{t,x)\ < ^{t,x), ^{t,x) e Z, (22) 

where ip,ilj E W are two bounded a-excessive functions. We also assume that g,h satisfy 
the condition (TT3l) . Suppose there exist bounded a-excessive functions Vi(t,x),V2{t,x) e W 
such that 

g{t, x) < vi{t, x) - V2it, x) < hit, s), V(t, x) E Z, (23) 

in which case we say g and h satisfy the separability condition [3]. 

Define the sequences of a-excessive functions {fn} and {ipn} inductively by 

V'o = ^0 = 0, ipn = e^„-i-h, ^n = e^„+g, n > 1, 
then the following holds: 



Lemma 3.2. Assuming ^23\), then Lpn) '4'n ore well defined and lini„_j.oo fn = f, linin-i>oo "^n = 
ip converge increasingly, strongly in J^ and weakly in both ^ and W . 

Proof. We only need to show the convergence in W and the rest of this lemma is just Lemma 
2.1 in jj8|. Firstly v'o = < f i and ipo G W. Suppose (pn-i G ^^ is well defined and satisfies 
V^n-i < Vi, then (pn-i — h < Vi — h < V2. Hence ipn = Gip„-i-h G ^^ is well defined by Lemma 
13.11 and we also have ipn < V2 since e^^_-^-h is the smallest a-potential dominating ipn-i — h. 
Now that lpn + 9 ^ V2 + 9 ^ vi, hence ipn = e^„+g G y^ is well defined and is dominated by 

Vi. 

Notice that ifo < (pi. Suppose ifn-i < fn, then ipn = e^^^-i-h < e^n-h = i'n+i, hence 
(fn = e^„+g < e^^^^+g = ifn+i- Also by Lemma Owe get 

WVnWw = llevn+sllr < KiWviW-^ + K^Wipn + 9\\.^- 

Notice that 9 < ipn + 9 < "^i, hence Wipn + 9\\jf is uniformly bounded in n, and as a 
consequence, \\fn\\w is uniformly bounded in n. In a similar manner we can show that 
WipnWw is uniformly bounded. The convergence of ipn,'4^n in ^ follows by Lemma 1.2.12 in 
0- □ 



Corollary 3.5. Under the separability condition, ip = e^^g, ip = e^^h, o,nd they satisfy 

(24) 



Sa{ip,ip) <Sa{'P,w), Ww e^^+gHW, 



Sa{^, ^) < £a{^, w), ywe ^^^h n W. 

Proof. Since (^ is an a-potential dominating ip + g, we get e^_^_g < (p. On the other hand, 
(p = lim^^oo V'n = hm^^oo e^„+g < e^+g, hence p = e^^g. Similarly ip = e^_h- The proof of 
(j2l|) is immediate by Corollary 13.21 D 



Corollary 3.6. // a pair of a-excessive functions (Vi, V2) satisfy 9 < Vi — V2 < h, then 

P ^ Vi, ip < V2, and w := ip — ip is the unique function in ^ satisfying 

£a{w,w) < Sa{w,w), Ww G ^, 9 < w < k, (25) 

where ^ = {w = pi — p2 + v : (pi, ^92^^ are a-potentials, v G W}. 

Proof. Clearly p>n-i — h < ipn and ipn + 9 < <^n, hence g < ip — ip < h. li 9,h satisfy the 
separability condition with respect to V^i, V2, then we would have </?„ < Vi and ipn ^V2, and 
as a consequence <p < Vi, ip < V2. 
Now (1251) is equivalent to 

£a{'^, ^) + ^a(^, ^) < £a{^, W + Ip) + £c,{lp, P - w) , g < W < k, 

which holds by flMl) . Suppose there are two solutions wi,W2 G ^ satisfying fl25|) . Notice 

iji— ? 



that Wi ~ W2 E W and ( '■"'^ ""^^ ^ wi — W2) = 0, so 



,dwi _ dw2 _ , 
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and consequently 

Aa{wi, W2) + Aa{w2, Wl) = Sa{wi, W2) + EJyW^, Wl). 

Therefore, 

Aa.{W\ - W2, Wl - W2) = Aa{Wl, Wi) + Aa{w2, W2) " ^q(Wi, ^2) - ^0(^2, ^l) 

= Aa{Wl, Wl) + Aaiw2, W2) - £^^(^1, t^2) " £a{w2, Wl) < 0, 

which imphes that Wi = W2 a.e. D 

Let (fjipjW be the a-excessive modifications of ip,ip,w, respectively. We further define 
for arbitrary pair of stopping times r, a the payoff function Jz{t, a) as 

Ur, a) = E, [e-"^^^'^) ((?(Z,+.)/.>, + /i(Z,+.)/,<.)] , z e Z. (26) 

Then we have the following result: 

Theorem 3.2. Assuming the separability condition on g, h and conditions / fiOj) [T^) . There 
exists a finite finely and cofinely continuous function w{z) G ^ satisfying [2D\) and the 
identity 

w{z) = sup inf J2(r, cr) = inf sup Jz(r, cr), Wz = {s,x) G Z, (27) 

where a, r range over all stopping times. Moreover, the pair f, a defined by 

f = inf{t > : w{Zs+t) = h{Zs+t)}, cr = inf{t > : w{Zs+t) = giZ^+t)} 
is the saddle point of the game in the sense that 

Jzir, a) < Jz{r, a) < Jz{r, a), z E Z, 
for all stopping times r, a. 
Proof. We only need to prove (!27|) . By Theorem 13. ![ for any 2; G Z we have 

^{z)=snpE,[e-'''^{^l, + g){Z,+,)] = E,[e-''^{i, + g){Zs+a)], 

(28) 
ij{z) = snpE,[e-^^{0 - H){Zs+,)] = E,[e-''^0 - h){Z,^,)], 

T 

and for any stopping times cr < a, r < a, 

^{z) = E,[e-"'^<^(Z,+.)], i,{z) = Eje-"^|(Z,+.)], ^z = {s,x) G Z. 

From ( 12T1) . we could take {e~"*(^(Zs+i)} and {e~"^v{ZsJ^t)} as non-negative Pz-supermartingales, 
therefore, for any z G Z and any stopping times r, a, we have 

^{z) > E,[e-"'^<^(Z,+<,)], l(^) > E,[e-"^|(Z,+.)]. 

Consequently, for any 2; G Z, 

^{z) = ^{z) - i,{z) < Eje-"(^^^)<^(Z,+^^,)] - E,[e-"(^^^)|(Z,+^^,)] 

= E,[e-"(^^^)^(Z,+^;,.)] < E, [e-"(-^-) {g{Z,+^)I,^, + h{Z,+,)I,<,)] = Ur,a), 

where the last inequality is due to the fact that g{z) < w{z) < h{z), Wz E Z and ( !28l) . In a 
similar manner, we can prove that w > Jz{t, a), and this completes the proof. D 
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3.3 Time Inhomogeneous Stopping Game with Holding Cost 

Usually the optimal stopping games involve a holding cost function / G M' ^ see, e.g., [9], 
and the return functions become 



Jl^^^{a) = E(,,,) n e-'^'fis + t, Xs+t)dt + e-"^(?(s + a, X,+,)\ 



(29) 



and 



+ E(,,,) (e-"^'^^^) ((7(s + a, Xs+a)h^r + /^(s + r, X,+,)/,<,)) , 

but this model can be essentially reduced to the classical stopping problem by taking g = 
9 ~ Raf and h = h — R^f instead of g and h respectively, where R^ is the resolvent and 
Raf is considered as a version of Gaf € W . We assume that conditions f lT^ flT^ also apply 
to g for the optimal stopping game (and similarly conditions (!22|) ( l23|) apply to g^ h for the 
zero-sum game). 

Theorem 3.3. Let g he a finely continuous function satisfying / fi^) . Assume ^^^ on g and 
the absolute continuity condition pOj) on pf Let e^ he the solution of 

8^{el, i^ - el) > (/, V^ - e^)^, V^^ G ^, n W, (31) 



anc 



d let e{ be its a-excessive regularization. Then 



el{z) = sup j/(ff), yz = (s, a;) G Z, (32) 

cr 

where JI{cf) is defined as in ^2^1 . and e^^z) is finely and cofinely continuous. Furthermore, 
let the set B = {z & Z : e^iz) = g{z)} and let aB be the first hitting time of B defined by 
as = inf{t > : e^(^s+t) = g{Zs+t)}, then 

el{z) = E,[e-^'^-g{Zs+.,)]. (33) 

Proof. Define the function 

jf(a) = E,(e-"'^^(s + a,X,+.)), 

where g = g — Raf, and let e| = sup^. Jl^{a), then by Theorem 13. ![ e| solves 

^a(e|,^-e|)>0, V^G^^n^, (34) 

and the optimal stopping time is defined by aB = inf{t > : eUZs+t) = g{Zs+t)}- 
By Dynkin's formula, 

E(s,x) ( I e-'^'fis + t, Xs+t)dt\ = RJ{s, x) - E(,,,) (e-"'^/?„/(s + a, X,+<,)) , 
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which leads to 

hence e^(z) = e({z) + Raf{z). 

Now let el^z) = e^i^z) - Rafiz), ip = ijj - R^f in (El]) we get 

£^{el-GJ,i:-el)>0. (35) 

Since £a{Gaf,'4^ — ^i) = (/, ^ — eO,^, this proves fl?I]) . Also notice that the optimal stopping 
time can be written as ctb = inf{t > : e^{Zs+t) = fl'(^s+t)}, and this completes the 
proof. n 

Similarly we can modify Theorem 13.21 and get the following result: 

Theorem 3.4. Letg,h be finely continuous functions satisfying [2^) and [23^) . Assume U^) 
on g, h and the absolute continuity condition fT^) on pf Then there exists a finite finely and 
cofinely continuous function w-^ E ^ , g{z) < w^ {z) < h{z), such that 

£aiw^,u!-w^)>if,u!-wf),^, ^w G ^ , g < w < k, (36) 

and 

iD-^ (2;) = sup inf j/(r, cr) = inf sup j/(r, a), V2; = (s, x) G Z, (37) 

where Jl{T,a) was given by ^3^) and cr, r range over all stopping times. Moreover, the pair 
f, a defined by 

f = inf{t > : w^iZs+t) = hiZs+t)}, cr = inf{t > : w^iZ^+t) = 9{Zs+t)} 

is the saddle point of the game in the sense that 

j{{f,cx)<j{{f,a)<j{{T,a), zeZ, 

for all stopping times r, a. 

As an extension of Corollary 13.61 we have the following: 

Corollary 3.7. The variational inequality (E^j has a unique solution. 

Proof. The case where / = was proved in Corollary 13.61 For a general / G J€^, notice 
again that (/, w — w^),yp = Sa{Gaf, w — w^), we get 

£a{wf - Gj; {w - GJ) - {w^ - GJ)) > 0, \/we^, g<w<h. 

Let w^ = w^ — Gaf, w = w — Gaf, g = g — Gaf, h = h — Gaf, we get 

8a{w^ , w - w^) > 0, Ww e ^, g <w <h, 

which has a unique solution in view of Corollary 13.61 D 
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4 Time Inhomogeneous Stopping Games of Ito Diffu- 
sion 

In this section we are concerned with a multi-dimensional time inhomogeneous Ito diffusion: 

dXt = b{t, Xt)dt + a(t, Xt)dBt, Xq = x, (38) 

where 



Xt 



f Xu\ 



V Xnt J 



h\ 



')n J 



( 



an 



ai^ 



\ flnl 



\ 



/ 



Bt 



f Bu \ 



\ Bmt J 



,m > n, 



and aij,bi,i = 1,2, ...,n,j = l,2,...m, are continuous functions of t and Xf. Define the 
square matrix [Aij] = A = ^aa^. We assume A is uniformly non-degenerate, and a, b 
satisfy the usual Lipschitz conditions so that fl38l) has a unique strong solution. Bt in fl38|) 
is assumed to be the standard mult i- dimensional Brownian motion. Thus we are given a 
system {Q, T , Tt, X, 9t, P^), where (fi, F) is a measurable space, X = X{u) is a mapping of 
fl into C(M"'), J-j is the sigma algebra generated by Xs{s < t), and 9t is a shift operator 
in Q such that Xs{6tuj) = Xs+t{^). Here Px{x G M) is a family of measures under which 
{Xt,t > 0} is a diffusion with initial state x. 

At each time t, define the infinitesimal generator L^^' as 



Lit) 



du 



U[X] 



E^«('^'^)7):r + E^^'^('^ 



dxidxi 



(39) 



Let the positive Radon measure m(dx) = p^^\x)dx, where p*^*-* satisfies 

AVp(*) = p(*V, Vt, 



and/ii = 6i-E"=i &fv 
reduces to 



1, 2, ..., n. Notice that when a and b in 



(40) 
are constants, p*^*) 



p^'\x) 



^{A'^b)-x 



Thus the associated Dirichlet form {E^^\ F) densely embedded in if = L^( 
given by 

E''^Hu,v) = I Vm(x) ■ AVv{x)m{dx), u,v e F, 



m) is then 

(41) 

where 

F = {u ^ H : u is continuous, ||m|||' = E\ {u,u) < oo}. 

Now we can define the sets ,'^ , ,^ , W in the same way as in Section [21 and define the time 
inhomogeneous Dirichlet form £a as well. 
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Since Xj is a non-degenerate Ito diffusion, the absolute continuity condition on its tran- 
sition function automatically holds, and for the same reason, the fine and cofine continuity 
notion can be changed to the usual continuity. 

Let / G M' , g E W he continuous functions satisfying the conditions as in Section 13. 3[ 
and define the return function J/(cr) as in fl29|) . then we have the following result: 



Theorem 4.1. Assume u^) U^) on g and the absolute continuity condition / iTOj) onpt- Let 
el be the solution of 

£^{el i; - el) > {f,^P - e{)^, V^ G ^, n W, (42) 

and let e^ be its a-excessive regularization. Then 

el{z) = sup J/ (a), Vz = (s, x) G Z, (43) 

where Jl{cr) is defined as ^MM), and el{z) is continuous. Furthermore, let the set B = {z E 
Z : (ii{z) = g{z)} and let (Tb be the first hitting time of B defined by as = inf{t > : 
^iZs+t) = giZs+t)}, then 

ei{z) = E^[e-'^'^-g{Zs+^,)]. (44) 

For the zero-sum game of Ito diffusion with the return function J^{a,T) as defined in 
(!30|) . we have the following result: 

Theorem 4.2. Let g, h be continuous functions satisfying [2^1 and / fl3|) . Assume (Q^j 
on g,h and the absolute continuity condition ( flOj) on pf. Then there exists a finite and 
continuous function w^ G ^ , g{z) < w^{z) < h{z), such that 

£aiw^,w-w^)>{f,w-wf)j^, ywe^,g<w<h, (45) 

and 

w-^(z) = sup inf j/(r, 0") = inf sup j/(r, cr), Vz = (s,x)gZ, (46) 

where a,T range over all stopping times and J^{a,T) is defined in i^3U\) . Moreover, the pair 
f, a defined by 

f = inf{t > : w^iZs+t) = HZs+t)}, ^ = mi{t > : w^iZ^+t) = giZ^+t)} 

is the saddle point of the game in the sense that 

J{if, a) < Jf{r, a) < Jl{r, a), 2; G Z, 

for all stopping times r, a. 
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